Claims 

We claim: 



^ ^ . A video clas^cation system comprising: 
5 a story seWent identifier that processes a video stream and partitions the video stream 

into a plurality of st.ory segments, and produces one or more key fi-ames that are associated with 

each story segment of the plurality of story segments, and 

\ 

a classifier, operably coupled to the story segment identifier, that associates one or more 

classifications to each -story segment of the plurality of story segments, to facilitate a selection 

\ 

10 among the plurality of story segments based on the one or more classifications. 

2. The video classification system of claim 1, wherein: 
i the video stream includes an associated text stream, 

the story segment identifier partitions the text stream into an at least one text segment 
015 corresponding to at least one each story segment of the plurality of story segments, and 

ru 

%j the classifier associates the one or more classifications to the at least one each story 

"■^ segment based on the at least one text segment. 

Pj 3. The video classification system of claim 1, wherein: 

%0 the video stream includes Vn associated audio stream, 

B the story segment identifiei^partitions the audio stream into an at least one audio segment 

corresponding to at least one each story segment of the plurality of story Segments, and 

the classifier associates the one or more classifications to the at least one each story 



25 



segment based on the at least one audio segment. 

\ 
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4. The video clasMication system of claim 3, wherein 

the classifie^ncludes a converter that converts the at least one audio segment into an at 
least one text segmenWid the classifier associates the one or more classifications to the at least 
one each story segment based on the at least one text segment. 

' . \ 

5. The video classification system of claim 1, fiirther including 

\ 

a visual characterizer, o^erably coupled to the story segment identifier and the classifier 
that provides a visual characterization of at least one each story segment of the plurality of story 
segments based on an image content of the at least one each story segment, and wherein 
10 the classifier associates the one or more classifications to the at least one each story 

segment based on the Visual characterization. 

% 6. The video classification system of claim 5, wherein the visual characterizer includes 

nJ a figure recognizer that recognizes a recognized figure from a plurality of recognizable 

di5 figures based on the image content, and wherein 

f% i 

the visual characterizer characterizes the at least one each story segment based on the 
H recognized figure. 

JfJ 7. The video classification system of claim 5, wherein the visual characterizer includes at least one 
1^0 of a text recognizer, a figure recognizer, and a flesh tone recognizer. 

8. The video classification system of claim 1, wherein the story segment identifier partitions the 
video stream based on at least one of a recognized figure, a recognized scene, a video cut, and a 
detected commercial. i 

25 \ 

\ 

9. The video classification system of claim 1, wherein the. one or more classifications include at 



least one of: program type, news type, media, person, locale, popularity, and keyword. 
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10. The video Ylassification system of claim 1, wherein each story segment of the plurality of story 
segments incluoe one or more scenes and the one or more key frames correspond to a frame 
within each of th&one or more scenes. 

\ 

11. The video classification system of claim 1, wherein the one or more key frames are determined 
based upon a transform of an encoding of the each story segment of the plurality of story 
segments. 



12. The video classification system of claim 11, wherein the transform includes a discrete cosine 
transform, and the encoding is in an MPEG encoding. 

13. The video classification system of claim 1, wherein the video stream is communicated from at 
least one of: an analog signal broadcast, a digital signal broadcast, a satellite broadcast, a cable 
broadcast, an Internet connection, a recorder device, and a playback device. 

14. The video classification system of claim 1, further including 

a storage device that stores the plurality of story segments. 

15. The video classification system of claim 14, wherein the storage device is at least one of a 
VCR, a DVD, a DVR, a CD-RAV, and a computer memory. 

V 

16. The video classification system of claim 1, wherein at least one of the one or more key frames 
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17. A retrievak system for retrieving story segments of a plurality of story segments based on one 
or more classifications associated with each story segment of the plurality of story segments, the 

retrieval system comprising: 

\ 

a filter that identifies one or more filtered story segments of the plurality of story segments 
5 based on the one or mbre classifications that are associated with each story segment, 

a presenter, operably coupled to the filter, that sequentially presents one or more key 
fi-ames that are associated with the one or more filtered story segments on a display. 

18. The retrieval system of claim 17, wherein 

10 the filter includes a sorter that associates a ranking to each story segment based on a 

correlation of the one or more classifications to one or more preferences, and 

the one or more filtered story segments are identified based on the ranking associated with 
^ each story segment. 

nl5 19. The retrieval system of claim 18, wherein 

'Zi the presenter presents the one or more key fi'ames in dependence upon the ranking 

'"'^ associated with each story segment. 

20. The retrieval system of claim 18, fiirther including 

^0 a profiler that produces the one or more preferences. 

21. The retrieval system of claim 17, wherein the one or more classifications include at least one 
of: program type, news type, media, person, locale, popularity, and keyword. 

\ 

25 
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22. The retnteval system of claim 17, further including 

a playet operably coupled to the presenter, that presents a selected story segment of the 
more filtered story segments based upon the < 
the display at a timeWhen a user effects a selection. 



one or more filtered story segments based upon the one or more key frames that are presented on 



23. The retrieval system of claim 22, wherein the player also presents a portion of each of the one 

\ 

or more filtered story segments sequentially. 

\ 

24. The retrieval system of claim 17, further including 

'\ 

10 a storage device for storirfg the plurality of story segments. 

\ 
\ 

25. The retrieval system of claim 24, wherein the storage device is at least one of: a VCR, a DVR, 
a CD-RAV, and a computer memory. 

26. The retrieval system of claim 17, wherein 
the presenter also presents at least one\pf one or more portions of an audio segment and 

one or more portions of a text segment that are associated with the one or more filtered story 



25 
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27. A videddevice comprising: 

a clas^fication device that classifies a plurality of segments of a video stream by producing 
a classification based on at least one of text, audio, or visual information associated with each 



segment of the plurality of segments, and 

a retrieval device that facilitate a selection of an at least one each segment of the plurality 
of segments by matdung the classification of the at least one each segment of the plurality of 
segments to an at least one user preference, and by presenting an at least one key fi-ame of the at 
least one each segment ofthe plurality of segments on a display. 



10 28. The video device of claini 27, further including 

a player that communicates the at least one each segment of the video stream to the 
display based on the selection of the at least one each segment. 

O 

29. The video device of claim 27, further including 
ai5 a storage device that stores the plurality of segments. 

""-^ 30. The video device of claim 27, wherein the video device is at least one of a television, a set- 

H top box, a video recorder, a computer, and a palm-top device. 



M20 3 1 . The video device of claim 27, further including 
0 a prefilter thj 

one user preference. 



a prefilter that filters a multichannel inpuUo provide the video stream based on the at least 



32. The video device of claim 31, wherein the prefilter filters the muhichannel input based on a 
25 'progr am-guide r^ 
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33. A user imerface for retrieving a selected segment of a plurality of segments of a video stream. 



imerfa< 

\ 



compnsmg: 

a mean^or rendering one or more key frames associated with one or more segments of 
the plurality of segments, and 

a means for\ selecting the selected segment based on the rendering of the one or more key 
frames. \ 



34. The user interface of claim, fiirther including 

a means for identifying one or more user preferences, and wherein 

10 the means for rendering the one or more key frames includes 

a means for determining a comparison between a classification of each segment of 

the plurality of segments and the one or more user preferences and wherein 

^ the rendering of the one or more key frames is dependent upon the comparison. 

f5 
fy 

□15 35. The user interface of claim, wherein: 

Jjj the means for rendering the one or more key frames includes one or more panes on the 

display, and _ _ ^ _ _ 

M: the one or more key frames associated with each of the one or more segments are 

ffi displayed sequentially in the one or more panes. 



36. The user interface of claim 35, wherein 

the means for selecting the selected segment includes a means for indicating a selection of 

\ 

a selected pane of the one or more panes, such tnat the selected segment corresponds to a one of 
the one or more segments that is associated with t\e one or more key frames being displayed in 



25 
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37. The user interface of claim, further including 

a meansVfor rendering the selected segment on the display. 

\ 

38. The user interface^of claim 37, further including 

a rendering con^o^for receiving render mode options, and 

a means for rendering portions of each segment of the plurality of segments in dependence 
upon the render mode options. 

39. The user interface of claim, wherein the means for selecting the selected segment includes at 

least one of a pointing device, a voice recognition system, a gesture recognition system, and a 

\ 

keyboard. 




40. The user interface of claim, wherein theaneans for rendering the one or more key frames of 



the plurality of segments includes a multi-dimensional presentation of at least one of: the one or 
more key frames, one or more user preference^and one or more user options. 
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